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Missile Autopilot Design using Adaptive CMAC 

Supervisory Controller 

ALI Bellahcene, JUN Wang 


Abstract — An adaptive CMAC-Supervisory (CMS) 
controller is proposed for aerodynamic missile pitch autopilot 
control. Missile motion is nonlinear and time-variant with 
unknown parameters. The controller is a combination of a 
supervisory controller and an adaptive CMAC (Cerebellar 
Model Articulation Controller). In the adaptive CMAC, a 
CMAC is used to approximate an ideal control law and a 
compensation controller to recover the residual of the 
approximation error. The supervisory controller is added to the 
adaptive CMAC to keep the system states within a predefined 
feasible set. The controller’s stability verified with a Lyapunov 
function. Simulation results are carried out to confirm the 
efficiency of the proposed control. 

Index Terms — Missile autopilot, adaptive control, CMAC, 
supervisory control. 


I. Introduction 

The principle of the pitch autopilot design is forcing the 
missile acceleration to track the acceleration command 
received from the guidance law. For that, several approaches 
have been developed over the years [l]-[5]. However, the 
dynamics of a tail controlled missile is non-minimum phase 
system. If we consider the angle of attack instead of the 
acceleration as output, this problem can be circumvented 
[ 6 ]-[ 8 ]. 

Recently, Artificial Neural Networks (ANNs) have become 
a hot research topic, due to their ability to solve nonlinear 
problems by learning [9]. In the aerospace engineering 
domain, ANNs have been applied successfully to flight 
control design, such as adaptive flight control [10]-[12], 
guidance law design [13], and missile autopilot design [14], 
[15]. Among many ANN architectures that have been 
proposed, the CMAC is the most popular neural model with 
distinguished features of being fast, simple to implement, 
solving nonlinear systems by the imposition of learning in 
offline mode [16]-[17], especially for modeling, system 
identification and control [18]. The advantages of using 
CMAC over other ANNs are well discussed in [19], [20]. The 
supervisory controllers have been proposed for stabilizing the 
system states around a predefined feasible set [21], [22]. 

In this paper, an adaptive CMS controller is proposed for 
designing a missile pitch autopilot which is aerodynamically 
controlled. Missile motion model is nonlinear and 
time-variant with unknown parameters, which could be due to 
errors in aerodynamic modelling. This controller is a 
combination between an adaptive CMAC and a supervisory 
controller [23]. The adaptive CMAC is presented to 
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collaborate with the supervisory controller for stabilizing the 
system states around the predefined feasible set and satisfying 
the tracking performance. If the system states move away 
from the predefined feasible set, the supervisory controller 
starts working to push the states back, otherwise, it stays 
inactive. The controller’s stability has been proved by using a 
Lyapunov function. A comparison between the feedback 
linearization controller and the proposed adaptive CMS 
controller is performed. The efficiency of the proposed 
controller is confirmed by simulation results. 

This paper is organized as follows: the mathematical 
nonlinear model of the missile is introduced in section II. The 
design procedures of the proposed adaptive CMS controller 
are constructed in section III. Simulation results are provided 
to validate the efficiency of the proposed controller in section 
IV. Conclusions are drawn in Section V. 


II. Nonlinear Missile Model 


A. Missile model 


Consider the first-order dynamics of actuator in the pitch 
plane, the nonlinear model of missile motion is given by [6]: 
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where a,q and 8 are angle of attack, pitch rate and control 


fin deflection angle, respectively, and Q,S,m,V,d and / 

are dynamic pressure, reference area, mass, velocity, 
reference length and pitching moment of inertia, respectively, 
and M m represents Mach number. Also, 8 C and co a are 

control input and actuator bandwidth, respectively. The 
aerodynamic coefficients in Eq. (1) are described in terms of 
Mach number and angle of attack as: 


B z = b \ M m + b l 

B m = h M ,n + b 4 

C z («’ M m ) = h («)+ ( a ) M ,n 

c m (a, M m ) = <f> m{ (a)+<j> m2 {a)M m 
0, l (a)=h l a 3 + h 2 a\a\+ h 3 a 
(j)^ (a) = h 4 a a\ + h 5 a 
<p m i (or) = h 6 a } + hjalal + h%a 
(f > m2 (a) =fy*|a| + /!,(,« 

where b t and h { are the constant coefficients. 
From Eqs. (1) and (2), we get 
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X, = f l (x 1 )+x 2 +g l x 3 
*2 = f 2 ( X l)+g 2 X 3 


where 
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Aerodynamics uncertainties modeling 
Consider aerodynamics uncertainties and rewrite Eq. (3) as 
*1 = /l fa )+ A/i fa)+ x 2 + fa + Ag! ]x 3 
*2 = f2(x l )+hf 2 {x l )+[g 2 +/±g 2 \c 2 (5) 

x 3 = m a u - co a x 2 

where 

A/i fa) = (xj)+ C, A<A zl fa) + ACjA^ d fa) + ACj 

A2 fa + C i A <L fa )M,„ + AQ A^ 2 fa )M, b 
A/ i fa) = A Q?U fa) + C 2 tx<j> m i fa) + AC 2 A(z) ml fa) + AC 2 

• fi m2 ( X l ) M m + C 2 A^2 (x, )M,„ + AC 2 A0 m2 (x, )M,„ 


AC, = 


Ag, = AC, /i + C l AB_ + AC, A/C 
Ag 2 = AC 2 B m + C 2 AB m + ACAfi 
AQS 
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„ AQSd - - 
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AB z =p 4 B z , AB m =p 5 B m 

I a ^|^p 2 |^|. *= 1.2 

and (i = 1,.. .,5)represent random constant perturbations. 
From Eq. (5), it can be obtained that 

[x = /(x)+g(x )u(t)+d(t) 

< 

y = x 

where x — x l - a 

y( x ) = ^E][/ i (xi)+x 2 +giX 3 ]+/ 2 (xi)+g 2 X 3 -gift) fl X 3 
ox l 

g( X )= 8 l^a 


( 6 ) 


and y <g 9 ? are the control input and output, 
respectively, d(t ) is the aerodynamics uncertainties, 

and x = [v p v 2 , x 3 J g is a state vector of the system that is 
assumed to be available. 

The objective is to design a missile pitch autopilot such that 
the output system y can track a given reference 

trajectory y d e . We define a tracking error vector as 

E = [e,eJ (7) 

where e = y d - y is the tracking error. If the parameters of the 

dynamic model and the aerodynamics uncertainties are 
available (i.e., the functions/(x), g(x)and d(t) are known), 

then the so-called Feedback Linearization technique can 
solve the control problem [24]. In this case, the 
functions/(x), g(x)and(i(?)are used for construction of the 

ideal control law. 


* 

u 



where K = [k y , k 2 J e 9I 2 , in which k i (i = 1 , 2 ) are positive 

constants. Applying the control law ( 8 ) to system ( 6 ), the error 
dynamics is obtained. 

e + k x e + k 2 e = 0 (9) 

K is selected such that the real part of the solutions of 
/z(y) = s 2 + k x s + k 2 are strictly negative. This means that 
tracking of the reference trajectory is asymptotically achieved 
where lim e{t) —» 0 when t —» go for any starting initial 
conditions. 

However, in practical applications, the exact knowledge of 
system/(x x)and d(t)is unavailable, which implies that 

the ideal control law ( 8 ) is unrealizable. Thus, in the following 
section, an adaptive CMS controller is proposed for designing 
a missile pitch autopilot. 


III. Missile Autopilot Design based on Adaptive CMS 

Controller 

Fig. 1 describes the configuration of the missile autopilot 
based on the adaptive CMS control system, which is 
composed of an adaptive CMAC and a supervisory controller. 
The control law takes the form. 

u-u a fu s ( 10 ) 
where u s is the output of the supervisory controller; 
u A = tt CMAC + u c is the output of the adaptive CMAC, which 
consists of a CMAC u CMAC and a compensation controller 
u c . The supervisory controller can be conceived to push the 

states of the controlled system around a predefined feasible 
set; however, its performance is neglected. Therefore, the 
adaptive CMAC is presented to collaborate with the 
supervisory controller for stabilizing the system states around 
the predefined feasible set and satisfying the tracking 
performance. 

A. Supervisory Controller 

To control the divergence of states, it is necessary to design 
a supervisory controller. If the system states move away from 
the predefined feasible set, the supervisory controller starts 
working to push the states back, otherwise, it stays inactive. 
Only the adaptive CMAC will be used to imitate the ideal 
control law. 

From Eqs. ( 6 ), ( 8 ) and (10), the error dynamics in the 
space-state form is obtained as follows: 

E = AE+G m {u -u A -u s ) (11) 


where 
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Define the Fyapunov function as 
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( 12 ) 
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Fig. 1. Block diagram of the missile autopilot system based on the adaptive CMS controller. 


where P e TT n is a positive-definite symmetric matrix that 
satisfies the Lyapunov equation 

A r P + PA = -Q (13) 

and Q e 9?"" is also a positive-definite symmetric matrix. 

By using Eqs. (11), and (13) and taking the derivative of 
V s with respect to time, we have 

V = — E T PE + — E T PE 
2 2 

= - E T A T PE + - E t PAE + E T PG m (u - u A - u s ) 

2 2 


= -±E T QE + E T PG m (u-u A -u s ) 


1 r 

<— e t qe+ 
2 


E PG 

m 


u 


+ 


u 


I- E EG m u s 


(14) 


In order to formulate the supervisory control law u s such 

that V s < 0 , it is necessary to know the bounds of the 
functions /(x) and g(x). Therefore, we make the following 
assumption. 

Assumption : The bound functions f u (x), g u (x) and g L (x) are 

known such that /(x)| < f u (x) and £z.( x L < ?( x L<? t, (x) f or 

all xe[/ c , where f u (x)<o o , g t/ (x)<oo and g L (x)>0 . 
Moreover, the aerodynamics uncertainties is bounded 
by \d{t} < d u . 

Based on the assumption and by observing Eqs. (8) and (14), 
the supervisory control law u s is formulated as 


«, =I-sgn{E T PG m ) 


u a\ + 


'U 


+ 




+ 


k t e 


P-(f U {x)+d‘ 

§l\v 

where sgn(-) is a sign function, and the operator index 
f 1 V s > V 

I - < — V is a positive constant. 

0 v 5 <v 


(15) 


Substituting (8) and (15) into (14) and considering the 
case I = 1, yields 
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V s <--E t QE + 
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—riH x ) +J 

^l( x J 

<--e t qe< o 
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y d 


+ 


k t e 


u 


(16) 


Using the supervisory u s controller presented in (15), 

when V s > V , the inequality V s < 0 can be obtained even for 

non-zero value of the tracking error vector E . From (16), the 
supervisory controller is capable of leading the tracking error 
to converge to zero. 

However, due to the presence of sign function and the 
selection of the bounds f u (x), g L (x),d u , an excessive and 

chattering control effort will be resulted. Moreover, the 
transient tracking performance may be not satisfied. 
Therefore, to overcome these phenomena, the adaptive 
CMAC will be formulated in the following subsection. 


Association 
Memory Space A 



Receptive-Field 
Space T 

Fig. 2. Architecture of a CMAC 
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B. Implementation of CMAC 

The architecture of CMAC is shown in Fig. 2, which 
includes an input space, an association memory space, a 
receptive-field space, a weight memory space and an output 
space [16], [25]. The signal propagation and the basic 
function in each space of CMAC are introduced as follows. 


1) Input Space S 

Consider the input space S = [y,..., s n \e TT . For a given 


control space, each input state variable y is quantified into 

discrete regions called elements. The number of elements, n E , 
is designated as a resolution. In this design, the input state 
variables are 

S = E = [e,e f (17) 

2) Association Memory Space A 
In this space, a block consists of several elements. The 
number of blocks, n B , is generally larger than two. The 

operating principle of two-dimension CMAC is depicted in 
Fig. 3, with n E =9 and p = 4 (p is the number of elements 

in a full block), blocks A, B, and C divide the input state y, 

and blocks a, b, and c divide the input state s 2 . New blocks 

will be obtained by shifting each variable an element. For 
example, blocks D, E, and F for y, and blocks d, e, and f 


for s 2 are obtained by such shifts. 

Each block defines a receptive-field basis function, which 
can be represented as rectangular [16] or triangular or 
continuously bounded function (e.g., Gaussian [25], [26] or 
B-spline [27], [28]). Here, Gaussian function is formulated as 
the receptive-field basis function 


4 )= 


exp 


r 


v 


- m, k ) 


2 4 


V 


ik 


fork = \,...,n B (18) 


J 



Fig. 3. CMAC in two-dimension with p = 4 and ng = 9. 


where (j) lk (y) represents the k th block of the / th input y with the 


mean m ik and variance v ik . 


3) Receptive-Field Space T 


Several blocks forms areas called receptive-fields. Each 
location of A is compatible with a receptive-field. Define the 
multidimensional receptive-field function as 


f 


n i n 

b k (S,m k , v t ) = n4 4) = exp £- 


4 -«%) 


2 4 


i =1 


V 


1=1 


v,. 


ik J 


for k - \,...,n R (19) 

n R : Number of receptive-field. 

where b k is associated with the k th receptive-field, 
m* =[m lk ,...,m nk J e '.H" and v k =[v lk ,...,v nk J effT. 


The multidimensional receptive-field function can be 
represented as 



r(s,m,v)=k..,fcj 

(20) 

where 

m=[m[,...,m[,...,m^] r e5R” x "' ! 


and 

[ T T T Y nxn R 

v — [vj ,...,\ k ,..., y nR \ eiR 



4) Weight Memory Space W 


Each location of T is linked to a particular adjustable value 
in the weight memory space, can be represented as 







( 21 ) 


_ W n R 1 *" W n R o W n R p_ 

where w 0 = [w lo ,...,w ko ,...,w nRO ] ef' and w ko represents 

the connecting weight value of the o th output associated with 
the k th receptive-field. 

The weight w ko is initialized to zero and is automatically 
updated during online operation. 


5) Output Space Y 

The output of CMAC is the algebraic sum of the activated 
weights in the weight memory, and is represented as 

n R 

y a = w o • r (^m,v)=£w t/ l) l (S,m t ,v t ) 

k =1 

for o = l,...,p (22) 

The outputs of the CMAC can be represented as 

y = [yi. I = w r •r(s , ,m,v) (23) 


C. Compensation Controller 

Assume that there exists an optimal CMAC to approach to 
the ideal control law such that 

* * In * * *T * 

u =u CMAC \S, w ,m ,v )= w -T +8 (24) 

where s is the minimum approximation 

;Jc :Jc >{« 

error; w ,m ,v and T are the optimal parameters 
of w, m, v and T , respectively. 

Rewrite u , as follows 


11 A — 11 CMAC 


{s,w,m,\)+u c =w T -T+ u c (25) 

/v 

where w,m,v and T are the estimates of the optimal 
parameters of w,m,vandr . By subtracting (24) from (25), 
define an approximation error as 


~ * *7 * /V J SA 

u=u —U A = w -I +8- w • 1 - u c 

~ T i—i* /v T |—' 

= W • 1 +W • 1 +8-U 


c 


(26) 


where w = w - w and f = T -f. 


Based on Taylor theorem, and using the partial linear of the 
multidimensional receptive-field basis functions [29], [30], 

the expansion of T becomes 
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r = 
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r db x N 

T 



r db x N 
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AmJ 




V5v J 



T 

/ * \ 


db 2 N 

T 

UmJ 


(m -m)+ 


3v J 


f db 

n R 

\ T 



db n 

n R 

\ T 


/ 

m=rit 


5v 

/ 


u c = sgn 


[e t pg„) 




E t PG 


m 


(36) 

(37) 


(v - v)+ O, Then the stability of the proposed controller is guaranteed. 

Proof: Define a Lyapunov function as 
V{E, w,m ,\,s p ,t) 


v=v 


1 T 1 1 1 ^ 1 _9 

= — E PE H-w wh -m mn-v vh 8„ 


= C T m + H T \ + O t 

* /y * /y ■' * * 

where m = m —m, v = v -v and b k =b k —b k . 


(27) 


2 P v 


2 Pm 


2 A 


2rj 


(38) 

where s p = s p - s p represents the estimation error of the 
b k is the optimal parameter of b k , b k is the estimated uncertainty bound. Taking the derivative of V and using (13) 
parameter of b k ; 

O t g 9V lR is a vector of higher-order terms; 


C = 


db ] db 2 


db 
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db { db 2 
5v 5v 
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91 


nxn R xn R 


and (32), it is concluded that 
v(e, w, m ,v,e p ,t) 

= -E t PE + -E t PE —— w T j/ —- 

2 2 A, 
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91 
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db db 

where —- and —- are defined as 
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E T (A T P + PA)E + E T G m P{~ - s , _ 

^ P 


T A 

w w 


5A 
5m _ 

— 
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1 i 

^ T /\ A os/ T /v A os/ /\ 

— m m-v v- 8 8 

A, A 7 p p 
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= - - £ r ££ + £ r G„,p(w r f + w r (c r m + H T v) 


— u 


c 


(29) 


Rewrite (27) as 

T* =f + C T m+H T v + O t 
Substituting (30) into (26), yields 


x 1 1 11 

+ -w w-m m-v v- 8 ..8 

B B B 

r^W r m r V 


71 


P P 
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(f + C T m + H T v + O t ) 

+ w T (c r m + /f r v + G,)+^ _ 
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m + H 1 v +w 


)+w r (c r 


m + // v 


(30) From (15) and (33)-(37), (39) can be rewritten as 

y(£,w,m,v,A’ f ) 

= _ I + ( D _ Mc _ )_ I £ i 

2 7 
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(39) 


= ~-E t QE + E t PG,„D - E T PG,„U C - E T PG,„U S 

~ ^ m m ( m o 


+ W O t +8~U C 


= w y r + w 7 (c 7 m + // 7 v ) + D — 
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(31) 


( \ r r 

'T' r T 1 (—in_i i 

C l m+H‘ vJ+ w O t + represents the l 
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uncertain term and it is assumed to be bounded with a small 
positive constant (i.e., Z9 <e ). From (26) and (31), the 

error dynamics ( 11 ) can be rewritten in space state as 
E = AE + G m {u-u s ) 


<--E t QE + E t PGD - £, 


E T PG. 


m 


~ ( £ r ~ A ) 


£ r />G 


m 


1 


= A£ + G m (w r f + w r (c r fh + // r v)- 


<—E QE- 
2 


u c + D-u s 


(32) 


£ r PG m |(A,-|^|)<0 (40) 

Since v(e, w,rh, ,t) < 0 is a negative semi-definite 
function, £,w,m,v and s are all bounded. Consider the 


Theorem : Consider the nonlinear missile autopilot problem 
presented in ( 6 ). The adaptive CMS control system is function E(f) = l/2 E T QE = —v(t) and by 

designed as ( 10 ) where the supervisory controller is described integrating S(/)with respect to time 

in (15) and the adaptive CM AC is formulated in (25). Here, in 
the adaptive CMAC, the adaptive laws are chosen as 
(33)-(35) and the compensation controller as (36) with the 
estimation law given by (37), where (5 w , [5 m , (3 v and 77 are 

strictly positive constants. 


t 

js(r)-Jr<y(£’,w,m,v,A,o)-v(£’,w,m,v,A,f) (41) 


Since 


,o) 


IS 


bounded, 


w = Pe'pgj 

(33) 

A = P m E T PG m C w 

(34) 

v = P V E' PG nl Hw 

(35) 


v(e, w, m, v, s p 

and V\E, w,in,is non-increasing function and 
bounded, it can concluded that: 


i 

lim [ s(r )-dr < oo 

t —>oo J 


(42) 
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Then, S(/)is bounded, so based on Barbalat’s Lemma [31], 
it can be noticed that limS(f)=0 . So, lim F(t) = 0 . 

t—> QO £—>■ GO 

Consequently, the stability of the proposed controller is 
ensured. 


IV. Numerical Simulations 

To find out the efficiency of the proposed adaptive CMS 
controller for the missile pitch autopilot, simulations were 
carried out. The missile model used in simulation is a generic 
short-range surface-to-air missile and are its aerodynamic 
coefficients given in Table I. First-order actuator model 
{co a =150 rad/s) is considered. 

The control objectives are as follows: 

• Maintain stability over the operating range specified by 
\a(t),M m (t)\ such that 

-10° <a(t)< 10° and 1.6 <M,„(r)< 2.6 

• Track step command in a c , with time constant ^0.2 sec, 

less than 10 % overshoot and steady-state error no greater 
than 2 %. 

Table I: Details of pitch axis missile model 


b x = 1.6238 

h 5 = 4.185 rad' 1 

b 2 = -6.7240 

h 6 = 303.56 rad' 3 

b 3 = 12.0393 

h 7 = -246.3 rad' 2 

b 4 = -48.2246 

h 8 = -37.56 rad' 1 

/i, = -288.7 rad' 3 

h,= 71.51 rad' 2 

h 2 = 50.32 rad' 2 

- 10.01 rad' 1 

h 3 =- 23.89 rad' 1 

CM 

d 

ll 

lT 

h 4 = -13.53 rad' 2 

C 2 =50 


The adaptive CMS controller designed here needs to have 
the bounds f u ,g u and g L . In this system, 



104.3 v 3 andg 


u 


= g L = 1 are chosen. 


Fig. 5 shows the simulation results under which the CMAC 
controller is designed alone, and Fig. 5(a) illustrates the AO A 
response and reference response for a step command. Also, 
Fig. 5(b) - (d) depict shows the associated control input, pitch 
rate and control fin deflection angle respectively. Although a 
good response is obtained, the chattering phenomena of the 
control efforts caused by the switching operation lead to the 
reduction of tracking accuracy. 

Fig. 6 presents the simulation results of adaptive CMS 
controller, and Fig. 6(a) illustrates the AOA response and 
reference response for a step command. Also, Fig. 6(b)-(e) 
shows the associated control input, pitch rate, control fin 
deflection angle and the supervisory control, respectively. 
Note that Fig. 6(e) shows one activation period [0, 0.0022] 
sec. After 0.0022 sec, the supervisory is deactivated. 

The comparison between three controllers is summarized in 
Table II, which shows that the adaptive CMS controller 
achieves the design requirement. 


Table II: Controller’s dynamic performances 


Controller 

Feedback 

Linearization 

CMAC 

CMAC- 

Supervisory 

Settling time 

(s) 

0.318 

0.28 

0.199 

Overshoot 

(%) 

4.8 

- 

0.17 

Steady-state 

error 

0.35 % 

0.29 % 

8.7xl0' 5 % 


V. Conclusion 


In all simulations, a 20% uncertainties existing in all random 
constant perturbation Pj(i- 1,_,5) is taking into 

consideration. 


A. Feedback Linearization Controller 

For the purpose of comparison, the feedback linearization 
control law presented in (8) was simulated. The controller 
gains are chosen as k x — 50 and k 2 - 225 . 

Using the feedback linearization controller, the simulation 
results for a step command is depicted in Fig. 4. Fig. 4 (a) 
illustrates the AOA response and reference response for a step 
command. Also, Fig. 4 (b) - (d) depict the associated control 
effort, pitch rate and control fin deflection angle, respectively. 


B. Adaptive CMS Controller 

The adaptive CMS controller has been depicted in Fig. 1, 
which uses Gaussian function as receptive field basis 
functions. The input space was partitioned in a grid of 

size , and receptive fields are selected to cover the input 


space {[-2,2], [-2,2]} along with each of the input dimension. 
Therefore, the parameters are chosen as 
v ik = 2^2 and m= [-2.5,-1.5,-0.5,0.5,1.5,2.5] for all i and k. 
The design parameters are set as follows: 


Q 


400 15 
15 1 



1-0 ,fi m 


J3 V =0.75,77 = 0.01, V = 1 


In this paper, an Adaptive CMAC Supervisory controller, 
including an adaptive CMAC and a supervisory controller, 
has been proposed to design a missile pitch autopilot for a 
nonlinear model which is aerodynamically controlled and 
contains unknown parameters and aerodynamic uncertainties. 
From the simulation results, the proposed control system 
achieves successfully the control objectives required. Future 
study will be applying this controller to other missile systems 
in order to further check its performance. 
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Lig.4. Simulation results for Leedback Linearization controller. 
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Fig.5. Simulation results for CMAC controller. 
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Fig.6. Simulation results for CMS controller. 
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